Web Survey Bibliography
Title Online graphic rating scales
Author Siegmar, O.
Year 2005
Access date 01.04.2005
Abstract The growing use of online questionnaires and the use of graphic rating scales online as well as in pencil and paper versions are the main reasons why this work was undertaken. Especially the variety of applications in online research compared to pencil and paper based surveys is seen as a field with much potential (1). Therefore the purpose of this presentation is to show the most interesting findings of my final thesis in psychology where I have developed and tested online graphic rating scales.Several different graphic rating scales with varying numbers of categories were developed and tested. This was done to have a sound methodological background for practical use and further development of them (2).So in this study interactive graphics which can be modified by the user, were developed. One of these scales was a scale of smilies (smile faces) whose mood could be modified by changing the curvature of the mouth.The construction and testing of the scales were solely done online.One of the most interesting outcomes was, that the smilies selected for the numbered positions of the scale were all much closer to the extreme anchors than would have been their mathematical calculated equivalent. Which means that the mathematically constructed scale would in no way fulfil the requirement of equidistance of rating scales. So equidistance only could be produced with a subjective rating of the smilies - which is exactly what was done in one of the experiments.Furthermore the same smilies were used in two different ways for the same object and produced different results. So besides the graphical attributes also the specific utilization of those single graphics are very important to avoid methodological artefacts.The experiments and the thesis are available at: www.anno77.de/siegmar (in German only).(1) Batinic, B., Werner, A., Gräf, L. & Bandilla, W. (1999). Online Research{:} Methoden, Anwendungen und Ergebnisse. Göttingen: Verlag für Psychologie.(2) Parducci, A. & Wedell, D. H.(1986). The Category Effect With Rating Scales: Number of Categories, Number of Stimuli, and Method of Presentation. Journal of Experimental Psychology: Human Perception and Performance, 12, 496-516.
Abstract - optional Grafische Ratingskalen finden wegen vieler Vorzüge immer mehr Verwendung in Fragebögen jeder Art. Da Onlinebefragungen wesentlich mehr und flexiblere Möglichkeiten für die Anwendung von grafischen Ratingskalen bieten und auch die "pencil and paper"-Versionen immer weiter ersetzen, sollte ihr Einsatz vorangetrieben und weiterentwickelt werden. Im Rahmen meiner Diplomarbeit habe ich verschiedene grafische Ratingskalen entwickelt und deren Eigenschaften getestet und verglichen (1). Die daraus resultierenden sehr interessanten und teilweise unerwarteten Ergebnisse sollen im Oral presentation vorgestellt werden.Es wurden verschiedene grafische Ratingskalen mit variabler Stufenanzahl entwickelt und getestet, um eine fundierte methodische Grundlage für deren praktische Anwendung, aber auch deren methodische Weiterentwicklung zu schaffen (2).In einer der Skalen wurden z.B. Smiliegrafiken verwendet, deren "Stimmung" durch eine interaktive Veränderung des Mundwinkels durch den Befragten angepasst werden konnte. Die Konstruktion, Überprüfung und Anwendung dieser Skalen wurde ausschließlich computerbasiert durchgeführt.Eines der interessantesten Ergebnisse war eine Verschiebung der subjektiv gewählten Smilies gegenüber den mathematisch ermittelten Positionen zu den äußeren Ankern bzw. Rändern der Skala hin. D.h. die rein nach mathematischen Regeln konstruierten Smilies für die Ratingskala erfüllten in keiner Weise den Anspruch an Äquidistanz. Deshalb wurde ein Konstruktionsprozess, der für diese Art von grafischen Skalen als beispielhaft gelten kann, durchgeführt, um die Äquidistanz zwischen den Stufen zu gewährleisten.Weiterhin ergaben sich für zwei verschiedene programmiertechnische Anordnungen ein und der selben Smilies unterschiedliche Anwendungseigenschaften. Also sind nicht nur die grafischen Eigenschaften der einzelnen Stufen, sondern auch deren Anordnung während der Befragung von größter Bedeutung für die Güte der Skala. Eine weitere Erforschung des unerwartet vorgefundenen Effekts steht noch aus.Als Fazit kann festgehalten werden, dass auch nur die geringsten Unterschiede zwischen Skalenkonstruktion und -anwendung zu signifikanten Effekten, also Methodenartefakten, führen können.Die Umfragen zur Konstruktion und die Diplomarbeit können unter www.anno77.de/siegmar aufgerufen werden.(1) Batinic, B., Werner, A., Gräf, L. & Bandilla, W. (1999). Online Research{:} Methoden, Anwendungen und Ergebnisse. Göttingen: Verlag für Psychologie.(2) Parducci, A. & Wedell, D. H.(1986). The Category Effect With Rating Scales: Number of Categories, Number of Stimuli, and Method of Presentation. Journal of Experimental Psychology: Human Perception and Performance, 12, 496-516.
Access/Direct link Homepage - conference (abstract)
Year of publication2005
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - 2005 (76)
- The ethics of research using electronic mail discussion groups; 2005; Kralik, D., Warren, J., Koch, T., Pignone, G., Price, K.
- The Analyses of Domestic Study about Internet Survey; 2005; Rui, L., Tie-ying, S.
- Controlling the Baseline Speed of Respondents: An Empirical Evaluation of Data Treatment Methods of...; 2005; Mayerl, J.
- Determinanten der Rücklaufquote in Online-Panels; 2005; Batanic, B., Moser, K.
- On the cost-efficiency of probability sampling based mail surveys with a Web response option; 2005; Werner, P.
- Expert workshop on mixed mode data collection in comparative social surveys; 2005; Roberts, C.
- The Effect Of A Simultaneous Mixed-Mode (Mail And Web) Survey On Respondent Characteristics And Survey...; 2005; Brennan, M.
- The total survey error approach. A guide to the new science of survey research; 2005; Weisberg, H. F.
- The professional respondent problem in online panel surveys today; 2005; Fulgoni, G.
- Satisficing behavior in online panelists; 2005; Downes-Le Guin, T.
- Reading behavior in the digital environment: Changes in reading behavior over the past ten years; 2005; Liu, Z.
- Rating versus comparative trade-off measures. Trending changes in political issues across time and predictive...; 2005; Thomas, R. K., Behnke, S., Johnson, Al., Sanders, M.
- Publication bias: Recognizing the problem, understanding its origins and scope, and preventing harm; 2005; Dickersin, K.
- Panel proliferation and quality concerns; 2005; Faasse, J.
- Gricean effects in self-administered survey. Ph.D. Dissertation; 2005; Yan, T.
- Drop-down boxes, radio buttons, or fill-in-the-blank? Web survey scale-type effects; 2005
- Does weighting for nonresponse increase the variance of survey means?; 2005; Little, R. J., Vartivarian, S.
- Big scale observations gathered with the help of client side paradata; 2005; Haraldsen, G., Kleven, O., Sundvoll, A.
- User Interface Design and Evaluation ; 2005; Stone, D., Jarrett, C., Woodroffe, M., Minocha, S.
- Adding Value to Data Through Improved Access. The Case for Web Portals; 2005; Baker, R. P.
- Multi-Mode Research and Data Linkage. Theoretical and Practical Advice; 2005; Terhanian, G.
- Architectural Design of a Survey Questionnaire and Respondent Data Repository. Practical Considerations...; 2005; Cookson, P., Sobell, J.
- Developing and validating a nursing website evaluation questionnaire; 2005; Tsai, S. - L., Chai, S.-K.
- Workaround: Site’s surveys beat pop-up blockers, yield responses; 2005; Arnold, C.
- The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research; 2005; Konstan, J. A., Ross, M. W., Rosser, B. R. S., Stanton, J. M., Edwards, W. M.
- Standards in Online Surveys. Sources for Professional Codes of Conduct, Ethical Guidelines and Quality...; 2005; Kaczmirek, L., Schulze, N.
- Computer adaptive testing; 2005; Gershon, R. C.
- Ego control and ego-resiliency: Generalization of self-report scales based on personality descriptions...; 2005; Block, J., Funder, D. C., Letzring, T. D.
- The Web experiment list: A Web service for the recruitment of participants and archiving of Internet...; 2005; Reips, U. -D., Lengler, R.
- Survey of substance use among high school students in Taipei: Web-based questionnaire versus paper-and...; 2005; Wang, Y. C., Lee, C. M., Lew-Ting, C. Y., Hsiao, C. K., Chen, W. J.
- Web Surveys. A Brief Guide on Usability and Implementation Issues; 2005; Kaczmirek, L.
- An assessment of measurement invariance between online and mail surveys ; 2005; Deutskens, E., de Ruyter, K., Wetzels, M.
- E-mail versus Web survey response rates among health education professionals; 2005; Kittleson, M. J., Brown, S. L.
- Toward An Open-Source Methodology: What We Can Learn From The Blogosphere; 2005; M.
- Aux Abonnes Absents: Liste Rouge Et Telephone Portable Dans Les Enquetes En Population Generale Sur...; 2005; Beck, F., ., Peretti-Watel, P.
- Web Versus Paper Questionnares: A Design and Functionality - Comparison; 2005; Jones, Ja., Fraser, C., Dowling, Z.
- Web Surveys and the new Disability Discrimination Act; 2005; Macer, T.
- Mixed-mode Surveys Using Mail and Web Questionnaires; 2005; Meckel, M., Baugh, P., Walters, D.
- Sampling procedure, questionnaire design, online implementation; 2005; Jackob, N., Arens, J., Zerback, T., Jowell, R., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S.
- Alternative Modes for Health Surveillance Surveys: An Experiment with Web, Mail, and Telephone; 2005; Link, M. W., Mokdad, A.
- An Experimental Comparison Of Web And Telephone Surveys; 2005; Fricker, S., Galesic, M., Tourangeau, R., Yan, T.
- Organizational Virtual Communities: Exploring Motivations Behind Online Panel Participation; 2005; Daugherty, T., Lee, W.-N., Gangadharbatla, H., Kim, K., Outhavong, S.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.
- Is a Web survey as effective as a mail survey? A field experiment among computer users; 2005; Kiernan, N. E., Kiernan, M., Oyler, M. A., Gilles, C.
- The effect of personalization on response rates and data quality in web surveys; 2005; Heerwegh, D., Vanhove, T., Matthijs, K., Loosveldt, G.
- When Methodology Interferes With Substance; 2005; Schoen, H., Faas, T.
- Web-based and Mailed Questionnaires: A Comparison of Response Rates and Compliance; 2005; Baelter, K., Balter, O., Fondell, E., Trolle-Lagerros, Y.
- Bleeding Edge or Proven Technology? The Fact and the Fiction of Mobile Survey Computing; 2005; Cameron, M. R.